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Abstract 

In this paper we consider the problem of disentangling multi-level 
systems by connecting the seemingly unrelated approaches of the Mori- 
Zwanzig projection operator technique and of the Ruelle response theory, 
for which we propose a new derivation. In a previous paper we have shown 
that by using the Ruelle response theory on a weakly coupled system it 
is possible to construct a surrogate dynamics for the slow variables, such 
that the expectation value of any observable agrees, up to second order in 
the coupling strength, to its expectation evaluated on the full dynamics, 
where both slow and fast variables are involved. We show here that such 
surrogate dynamics agrees up to second order to the effective dynamics 
one can derive by expanding perturbatively the Mori-Zwanzing projection 
operator, which creates, instead, an accurate representation of the trajec- 
tories of the slow variables. In the case of e.g. geophysical fluid dynamics, 
this implies that the parametrizations of unresolved processes suited for 
prediction (numerical weather forecast) and those suited for the represen- 
tation of long term statistical properties (climate) are closely related, if 
one takes into account, in addition to the widely adopted stochastic forc- 
ing, the usually neglected memory effects. This bears relevance for the 
current trend of aiming at seamless prediction. 

1 Introduction 

The investigation of multi-level systems is of primary interest for mathematics 
as well as for natural and social sciences, and is a central task of complexity 
science. In multi-level systems it is possible to separate the variables into (at 
least) two subsets, such that the variables with each subset are strongly coupled, 
while variables belonging to different subsets have a much weaker coupling. 

Moreover, in most practical cases, the dynamics of each level takes place 
in distinct spatial and temporal scales, so that it is hard to define an optimal 
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resolution for all the variables when we attempt to simulate the system or collect 
the data: we face a stiff problem [B] . Usually, one is interested in devising ways 
to account, at least approximately, for the impact of the fast processes occurring 
at small spatial scales on the slow variables, often describing large scale features, 
thus defining an effective autonomous dynamics for the slow variables. 

If one assumes a vast time-scale separation between the slow variables X 
and the fast variables Y, the averaging method [3J |H| allows for deriving a 
dynamics for the X variables. Abramov pQ has recently presented an interested 
application of this method for deriving a simplified dynamics for a system of 
geophysical relevance. Furthermore, projector operator techniques have been 
introduced in statistical mechanics with the goal of effectively removing the Y 
variables. In particular, a considerable interest has been raised by the Mori- 
Zwanzig approach, through which a formal - albeit practically inaccessible - 
solution for the evolution of the X variables (or of any observable A = A(X)) 
is derived [51] . 

Some of the most outstanding examples of complex systems featuring a 
multi-level structure can found in (astro)geophysical fluid dynamics, and, in 
particular, in the Earth's climate, whose variability spans tens of orders of mag- 
nitude in both space and time [12l [26] . As a result, even the most sophisticated 
climate or weather forecast models cover only a relatively small portion of the 
range of scales where variability is observed, and, often, one needs to select 
different approximations and even different formulations of the relevant dynam- 
ics depending on the problems under investigation [1^1 [Ml Hi]. Moreover, it is 
common practice and actual necessity to develop parameterizations for taking 
int account the effects due to the nonlinearity of the equations of the unresolved 
small scales processes (Y variables) on the scales explicitly resolved by the model 
(X variables) [TS1 [571 IS1 HI [5J [M] ■ Such parametrizations increasingly contain a 
mixture of stochastic and deterministic formulations [T7] . 

In a previous paper |28| we have approached the problem of defining an 
accurate effective dynamics for the X variable by focusing on the statistical 
properties of a general observable A(X) rather than on its trajectory. The 
starting point has been assuming that the coupling between the X and Y vari- 
ables is weak, and treating such a coupling as a perturbation to the autonomous 
dynamics of the X and Y variables, treated as unperturbed system. We have 
then adopted the response theory developed by Ruelle [ST] H31 EI] , which allows 
to compute explicitly how the long-time averages of Axiom A dynamical sys- 
tems endowed with SRB measure [25] change as a result of small perturbations 
to the flow [THl HI IU HU H5J . A detailed discussion of the relevance of the Axiom 
A dynamical systems for the description of actual physical processes is given 
in [THUS]. Thus, we have derived explicit formulas to compute the changes in 
the expectation value of A(X) up to the second order in the (weak) coupling 
strength between the X and Y variables. Moreover, we have been able to derive 
a surrogate perturbed dynamics for the system X such up to second order its 
statistical properties of A(X) are the same as those of the fully coupled (X, Y) 
system, thus deriving ab initio an explicit parametrization of the coupling. The 
correction due to the coupling entail a deterministic contribution to the dynam- 
ics, a stochastic forcing expressed as a sum of multiplicative noise terms with 
non-trivial correlation properties, and an integral expression which describes a 
memory term. The unavoidable presence of such memory term suggests that the 
deterministic and stochastic parametrizations currently used in climate models 
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have a fundamental flaw which should definitely be addressed. 

Geophysics provides further motivations for extending our previous analysis. 
While climate models aim at capturing the statistical properties of the climate 
system, weather forecast models try to solve an initial value problem within a 
finite time horizon. As a side note, one should mention that in more recent 
times, the prediction problem is cast in a probabilistic rather than deterministic 
way. Therefore, while both kinds of models face similar problems in terms of 
impossibility of resolving all relevant scales and require parametrizations, and 
describe - for the atmospheric part - processes occurring in the same domains, 
their goals are rather distinct. Nonetheless, recently it has been proposed to 
assess the quality of climate models by checking their skill for numerical weather 
prediction. The underlying idea is, loosely speaking, that in order to be able 
to represent the global properties of the climate attractor, the model should be 
able to describe well its local properties, which are easier to assess [20 . On a 
closely related line, currently, a general trend in geophysical fluid dynamics is 
the pursuit of the so-called seamless prediction [IS], whose goal is to develop 
models able to give convincing forecasts (in a probabilistic sense) for time leads 
covering very different time scales, ranging from days to years and more, thus 
covering problems like classical weather prediction to climate projections. 

An question left open in |28) was exactly the link between the surrogate 
dynamics for the X subsystem defined a posteriori in order to represent up 
to second order the coupling between the X and Y variables and the dynam- 
ics one would obtain by giving an explicit representation of the Mori-Zwanzig 
projection operator. As we understand from the discussion above, this, in the 
specific case of geophysical fluid dynamics, addresses the problem of whether 
parametrizations developed for weather forecast models can be used for climate 
models, and whether improvements in weather forecast models can be more or 
less automatically transferred into climate models. Moreover, as one can easily 
picture that increasing the resolution of a model amounts to switching on the 
coupling between the X variables and a larger and larger set of Y variables, 
what is discussed here has also relevance in the tantalizing effort directed at un- 
derstanding how the skill of (both climate and weather forecast) models changes 
with increasing resolution and how parametrizations should be changed when 
the resolution of a model is increased. 

We anticipate that this paper gives the comforting answer that, indeed, the 
surrogate dynamics derived in [28] and the dynamics projected using the Mori- 
Zwanzig operator are identical up to second order of perturbation. The key 
technical tool we use to obtain the proof is a Dyson expansion for describing 
the evolution of the uncoupled and coupled X and Y systems. While we have no 
proof for the generic n th order, it is reasonable to conjecture that such agreement 
exists at all orders. 

This article is structured as follows. In Section [2] we present the Dyson 
expansion for the evolution of the unperturbed and perturbed flows, and pro- 
vide a way to treat in a unified way the Mori-Zwanzig and Ruelle's approaches. 
In particular, we present a novel derivation of the Ruelle's response formulas, 
which provides a simple way to derive the non-perturbative correction for the 
statistical properties of a general observable, and rewrite the Mori-Zwanzig pro- 
jection operator in a more treatable form. We also explain how to construct all 
perturbative terms and define simple rules for constructing diagrams describing 
the various linear and nonlinear contributions. In Section[3]we then use our new 
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approach to deal with multi-level systems, thus deriving the explicit expression 
of the projected dynamics for the X subsystem according to the Mori-Zwanzig 
formalism up to the second order of perturbation due to the coupling with the 
Y subsystem. We show that such approximate dynamics agrees with what was 
obtained in [55] using the Ruelle formalism. In Section [4] we present our con- 
clusions and perspectives for future work. 

2 Expanding perturbed flows and averages 

Both the Mori-Zwanzig projection operator technique [HI [3D] and the response 
theory of natural invariant measures [21j feature an expansion of evolution op- 
erators II(t) = exp(Li), where L is a linear differential operator describing the 
dynamics of observables. As described in e.g. [5], this can be easily derived 
formally in the resolvent formalism, by taking the Laplace transform of such 
operator exponentials: 

/>oo 

£{n}(s) = / dtexp(Lt)exp(-ts) = (s - Ly 1 (1) 
Jo 

If L consists of a perturbation around an operator Lq, i.e. L = Lq + L±, we can 
expand the Laplace transform using the equality 

{A + B)- 1 = A- 1 - A^BiA + B)- 1 . (2) 

In the case of the Laplace transform in Eq. [T] we take A = s — Lq and B = —L\ , 
so that the A" 1 and (A + By 1 terms are themselves Laplace transforms of 
Ilo(f) = exp(Lo^) an d II (i) respectively. Making use of a non-commutative 
version of the fact that the Laplace transform of a convolution is the product 
of the transform, this results in the Dyson expansion of the evolution operator 
H(t): 

H(t) = II 0) + / dTn (t - r)L 1 n(r) (3) 
Jo 

Another decomposition is possible when making use of the following equality 
for operator inverses: 

(A + B)- 1 =A- 1 -(A + B)- 1 BA- 1 . (4) 

This gives rise to the following decomposition of EL(t): 

n(t) = n (t) + / dTU(t - r)L 1 n (r) (5) 
Jo 

In this section we will use these equations to derive the Mori-Zwanzig and 
the response theory in a uniform way, so as to highlight their similarities and 
differences. 

2.1 Projection operator techniques 

In the case of Mori-Zwanzig a projection is carried out on the level of the observ- 
ables to remove unwanted, irrelevant and usually fast degrees of freedom. Here 
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the expansion is performed around the evolution that involves only the relevant 
part of the phase space. If a dynamical system is defined on a Hilbert space Z 
with a relevant subspace X and its orthogonal complement y = X^ , then one 
defines a projection V of functions on the full phase space to functions on the 
restricted phase space X . For example, one can take a conditional expectation 
with respect to a measure on Z\ 

(vA)( X ) = J y A ^ )pix ' v)dy . 

J y p(x,y)dy 



The derivation given by Zwanzig in Chapter 8 of |31j for a generalized Langevin 
equation is based on Eq. |5| We write the Liouville equation for an observable 
A as 

dA (t) _ T am _ „tL r A- JL, 



dt 



LA(t) = e LA = e tL {V + Q)LA 



with Q = 1 — V. The term involving Q can be further expanded by making use 
of Eq. [5] with L = QL. This gives the following equation 



dA(t) 
dt 



= e tL VLA + {e tQL 



[ dse {t - s)L VLe sQL )QLA 
Jo 



In [3 lj it is argued that this equation is a generalization of the Langevin equa- 
tion, where the second term is a correlated noise term dependent on the initial 
conditions of the irrelevant degrees of freedom and the third term represent the 
memory of the system due to the presence of irrelevant variables that have in- 
teracted with the relevant ones in the past. If there is a time scale difference 
between relevant and irrelevant variables the noise becomes white, while the 
memory term can in this case be neglected, as the irrelevant variables decorre- 
late quickly. 



2.2 Response theory 

We consider as unperturbed system an Axiom A dynamical system endowed 
with SRB measure [29]. The goal of response theory is different from that of 
the Mori- Zwanzig technique. Here the averages of observables over a long period 
of time are of interest: 

p(A) = lim i f dtA(x(t)) = lim I f dtIl(t)A(x(0)) (6) 

Through the evolution of x(t), the evolution operator Tl(t) again enters into 
this equation. In the case of response theory the operator L that determines 
II consists of a perturbation around an unperturbed evolution: L = Lq + L\, 
meaning that we can make use of the expansions [3] and [5] to expand n(t) around 
IIo(£). The perturbing operator L\ can derive from an external forcing, or as 
we will later see from a coupling of internal degrees of freedom. The averages 
of an observable A for the unperturbed evolution, corresponding to Lq and IIo, 
will be denoted by p(A). 

We present here a different derivation than the one presented in |28j . where 
the response formula was derived by iteration Eq.[3]to obtain the different order 
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response terms. These terms can then be summed over all orders to obtain an 
expression for the full change in expectation value (as presented in [22 J. Here 
instead we will first derive the equation expressing the full change in expectation 
value, which can then be expanded in orders of the perturbation. 
By inserting Eq. [5] into Eq. [6j we have that 



p(A)=p(A) + lim i / dt [ drn(r)i 1 n (t-r)A(a ; (0)) 
= p(A)+ lim i / dr [ dtIl(T)LiIlo(t)A(x(0)) 

T^oo 1 J Q J Q 



(7) 
(8) 

p(A) + p[ I dtL{no(t)A) (9) 



or 



J dtL x Tl Q {t)) A 



P (A) = p 1 - / dtLMt) A (10) 



p(4) = pUl-| dtLM 



W) A) (11) 

By expanding the resolvent operator, one gets the response terms at different 
orders of Lf. 

p(A) = p(A) + p n dtxLJIoiti)^ 

+ P {L dtl L dt ^ n o{h)L 1 Il (t 2 )A^)+... (12) 
This expression is identical to what is given in |22) . 



3 Coupled systems 

The response theory described in Section [272] is quite general, in the sense that 
we have not defined the form of the perturbing operator L\. The perturbation 
can be a specified external forcing or an internal coupling of degrees of freedom. 
Here we choose the latter in order to make the comparison to the Mori-Zwanzig 
formalism. The dynamical system is given by an uncoupled vector field F plus 
a coupling function 'J: 

d ^= Fx {X) + ^ x {Y) 
dY 

— =F Y (Y) + * Y (X) (13) 
Writing this in terms of observables, we have 

dA ^Xl =( Lx (X, Y) + L Y (X, Y))A(X, Y) 
dt 

= (F x (X) + y x (Y)).V x A(X,Y) 
+ (F Y (Y) + * Y (X))S? Y A(X, Y) 

where V x and Vy denote the gradients with respect to the variables in X and 
in Y respectively, L x = (F x + $ x )Vj and L Y = (F Y + $y)Vy. 
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3.1 Response theory 

The response of the unperturbed system to the coupling can be calculated by 
taking L = F X {X).V X + F Y (Y).V Y and L x = *x(V).V x + *y(X).Vy. 

By Eq. [l2j the n-th order contribution to the response is calculated by inte- 
grating the impact of all rt-time couplings over the times between the coupling 
interactions: 

5^p(A)=Jdn...T n S^p(A\h,n;...;i n ,T n ) (14) 

i\ ,i n 

€{X,Y} 

where 

6^p(A\i 1 ,r 1 ; . .. ;i„,r n ) = / p (dx)L lyll Il (T 1 )L l7i2 no(T2) . . . L 1 . i Jl f) (T n )A{x) 



where x — (X, Y) and represents an interaction affecting the X or Y sub- 
system, depending on the subscript: 

Li,x = Vx(Y)V x 

L hY = ^ Y (X)V Y (15) 

Any infinitesimal contribution to the response can hence be seen as a sequence 
of couplings that are activated subsequently (ii to i n ) and the times between 
the interactions (ti to t„) as depicted in Figure [l] 

If one chooses as observable a function Ax that is only dependent on X, all 
response contributions up to second order are 5^ p(A x \X, t), S^p(A x \Y, Ti;X, t 2 ) 
and 5 { Vp{Ax\X, Tl ]X,T 2 ). The first order term 5^p(A\X,r) is given by 

5^ P (A\X,t)= J p (dx)L x U{r)A x (x) 

^p a: Y^x(Y))p ,x(V x Ax(f T (X))) . 

The 5Wp(A x \Y,Tx;X,T 2 ) and 8^p{A x \X, n; X, r 2 ) terms give 

S^p(A x \Y, Tl ;X,T 2 ) 

= Po,y (V Y *x(f Tl (Y)))p , x (* Y (X)V X (A X o D{r{X))) 
5^p(A x \X,t i; X,t 2 ) 

= Po,y (<f x (Y)* x (r(Y))) Po , x (V X (V X (A X o / 2 T )(/ Tl (A))) 

Note that since we perturb around the uncoupled system, the unperturbed 
measure po is a product of invariant measures po jX and po,y on the X and 



Y subsystems. For this reason and since the operators in 15 are products of a 
multiplication and derivation operators that commute whenever the dependence 
is on different variables, each response term can be written as a product of a 
Po,x and po,y average. 

As we have shown in 28J, if one collects these first and second order re- 
sponses to the coupling "J, an identical change in expectation values from the 
unperturbed po can be obtained by adding a ^-independent perturbing operator 
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Figure 1: Diagrams representing the response terms 5^p{A x \X, r) (diagram 
(a)), <5( 2 )p(A x |r,T 2 ;X,ri) (diagram (b)) and <5( 2 )p(A x |A, t 2 ; X, n) (diagram 
(c))- 



L\ tP to the uncoupled L - It was demonstrated that this can be accomplished 
by the following dynamical system: 



dX(t) 
dt 



pOO 

F x (X(t)) + M(X(t))+a 3 {t) + / drh(T,X(t-T)) (16) 

Jo 

where a mimics the correlations present in the fluctuations of the coupling from 
its uncoupled mean: 



(a, (t)a t (t + r))=p Y (^ x (Y)^ x (f Y (Y))). 
*' X (Y) = *x(Y)-p Y (* x ). 



(17) 



and h is a kernel representing the memory effected by the presence of unresolved 
variables. Here f Y denotes the uncoupled evolution of Y generated by F Y . 
The memory term h is given by 



h(r,X) = * Y (X)p Y (V Y *x(f Y (Y))) ■ 



(18) 



The M term derives from 5^p(A x \X, r), the a term from p(A x \X, n; X, t 2 ) 
and the h term from 5^ p(A x \Y,t 1 ]X,t 2 ). 

It should be noted that the choice of parametrization is not unique. Any 
time-dependent forcing a with the correct two-point time-correlations will give 
the right response up to second order. Also for the memory term there is some 
freedom. One can also use 

dX(t) 



dt 



= F x (X(t))+M(X(t)) + a j (t) + / drh(Tj 

Jo 



(t-r) 
X 



(*o)) (19) 



as X(t — t) is to zeroth order in \P equal to f x t \Xq). Hence the difference 
between the two parametrizations will be of order 



8 



3.2 Direct derivation of surrogate dynamics 



We now do a calculation in the style of the Mori-Zwanzig one in Section 2.1 for 
the dynamical system given in Eq. [13] and for observables Ax that only depend 
on the relevant variables X. As in Section [2~T| we first do a projection of the 
evolution equation of Ax to separate X and X and then expand the evolution 
of Y. 

The evolution equation for Ax is given by 

(j t A x )(X,Y,t)\ t=0 = (L X A X )(X,Y) = ((PL X + QL X )A X )(X 1 Y) 

= (Fx(X) + pvi^x) + i^x(Y) - py{^x)))VxAx{X) 

(20) 

where PA(X, Y) = J y p Y (dY)A(X, Y). We assume that X and Y start X and 
Y at time —t. We want to find a formal solution for ^ X (Y) that we can insert 
into the previous equation. 

The evolution of ^x is given by 

(j t *x)(X 0) Y Q ,t) =|^ Lx+L ^x(Xo, Y , 0) 

=(L x + L Y )^x(X ,Y ,t) 
=(F X {X ) + *x{Y ))Vx*x(X ,Y ,t) 
+ (F Y (Y ) + * Y (X ))V Y * x (X ,Y ,t) 

Making use of the decomposition of the Liouvillian L = Lx+L Y into Lq(Xq, Yq) = 
F x {X )Vx + F Y (Y )V Y and Li(X ,F ) = ^ X (Y )V X + *yft)Vy, we get 
by repeated use of Eq. [3] that 

*x(Y) = Vx(Xo,Y ,t) =e tL ^ Y ^x{Y ) = e^ Lo+L ^ x (Y ) 

=e tLo ^x(Y Q )+ [ dTeV-^Lie^VxPb) 
Jo 

=e"">*x(Y ) + [ dTe {t - T)La L 1 e TLa ^x(Yo) + 0(L 2 1 ) 
Jo 

(21) 

So we have 



(-A x ){X,X ,Y ,t)\ t = = [F x {X)+p Y (* x ) + a{t,Y ) + J drh(T,Y Q ) j V X A X {X)) 

(22) 

where 

a(t,Y ) =e tF ^ Y <'^^x(Y )~p Y ^x) 
h(r,X ,Y ) =e( t -^ Lo ^-^)i 1 (X ,r ) e ^( x - y °)vi/ x (y ) 

Due to the commutation of Fx^7x and FyVy, we have that 

h(T,Y ) ^ t -^ F ^- +F ^H^x(Yo)Vx + ^Y(Xo)V Y )e TF ^^x(Yo) 
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If Yq starts in the distribution py that is invariant under the flow generated by 
Fy , then the average of a is zero and the auto-correlation is equal to that of a 
given before in Eq. 17 



PY (a(t,Y ))=0 
py {a(t,Y )a(t + T,Y )) = pY (* x (Y )e TF ^y * X (Y )) 

and 

PY (h) = (e^^^riX)) p Y (V Y e TFYV ^x(Y )) (23) 
This gives us the memory term of Eq. |19| 

4 Summary and Conclusions 

The first main result contained in this paper is a new derivation of the Ruelle 
response theory [2"Tl |2"5I [TU] describing how the statistical properties of Axiom 
A systems are changed when the underlying dynamics is altered. We have 
shown that it is possible to obtain directly the exact expression for the expecta- 
tion value of an observable A computed according to the invariant probability 
measure of the altered dynamics as the expectation value of another suitably 
defined observable computed according to the invariant probability measure of 
the unperturbed dynamics. Such an expression can be expanded at all orders 
of perturbations, with the general term of order n corresponding exactly to the 
n th order term obtained by Ruelle through perturbative expansion. Unsurpris- 
ingly, the exact result obtained through direct calculation agrees with what was 
derived by Ruelle through summation of the perturbative series [2"T] . 

The Dyson expansion has been instrumental in approaching the problem 
of studying multi-level systems, by providing a peturbative expansion for the 
Mori-Zwanzig projection operator [31] . Denoting by X the subset of variables 
we are interested into and by Y the subset of variables we want to project out, 
we have derived the effective projected dynamics describing the evolution of an 
observable of the X variables only up to second order of perturbation. Such 
a dynamics is identical to the surrogate dynamics for the X variables derived 
in [55] by imposing, using the Ruelle response theory to describe the impact 
of the coupling of the X and Y variables, that the expectation value of any 
observable A = A(X) evaluated on the invariant measure corresponding to the 
surrogate dynamics agrees up to second order of perturbation to its expectation 
value evaluated over the complete (X, Y) system. It is important to note that, 
as discussed in |28j . the surrogate dynamics is not unique, because we require 
agreement only up to second order. This result provides a connection between 
the Mori-Zwanzig and Ruelle formalisms, which are seemingly different, the first 
one pertaining to trajectories, the second one to expectation values: we have 
that if we are able to follow closely (on the average) the individual trajectories, 
we are also able to model effectively the long-term statistical properties. Such 
a link between our ability to represent, in some sense, equally well, local and 
global properties in the phase space strongly relies on the fact that the projec- 
tion operator leads to introducing a stochastic term and a memory term: the 
price we have to pay for neglecting the Y degrees of freedom and still retaining 
a satisfactory representation of the X dynamics on short and long time scales 
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is going from a deterministic representation in terms of ordinary differential 
equations to an stochastic representation where integro-diffcrential operators 
are involved. In particular, the consideration of memory effects marks the dif- 
ference between what is discussed in this contribution and the classic method 
of averaging [3J [9] , which assumes that there is a vast time-scale separation be- 
tween the two systems X and Y, so that memory effects are negligible. This is 
the second relevant result obtained in this paper. 

So far, we have been able to prove by direct calculation such a correspondence 
between the Mori-Zwanzig and Ruelle approaches only up to second order, but it 
is reasonable to conjecture that the same applies at any order n of perturbation. 
If this is true, and taking the limit of n — > oo, one would get that the exact 
Mori-Zwanzig projected dynamics provides the unique surrogate dynamics for 
the X variables which is perfectly statistically compatible with the full (X, Y) 
system for any observables of the X variables only. Therefore, extending the 
proof we have given to all orders of perturbations would be extremely relevant. 

The results presented in this paper have relevance also in the context of the 
discussion on how to model practically and effectively high dimensional multi- 
scale systems such as those analyzed by the geophysical fluid dynamical com- 
munity. In particular, we refer to the problem of a) comparing models featuring 
different spatial resolutions; and b) constructing so-called parametrizations for 
the unresolved sub-scale processes. It is clear, from the rather general setting 
used here that increasing the resolution of a model amounts to enlarging the 
set of fast variables Y (this is particularly evident if one consider Galerkin- 
like expansions for the fields) coupled to the X slow variables, and devising 
parametrizations is nothing but approximating effectively the surrogated dy- 
namics. This was partly discussed already in 28j in the context of considering 
exclusively long-term statistical properties (the climate). What we have addi- 
tionally learnt in this paper is that the Mori-Zwanzig projected dynamics, which 
is instead relevant for reproducing effectively the time evolution (the weather 
forecast) of the slow variables only, provides the surrogate dynamics we need to 
have a convincing climate for the slow variables. This seems to support the idea 
of assessing the quality of climate models by testing their performance as tools 
for numerical weather prediction [20], and, more in general, points towards the 
direction of the so-called seamless prediction [TB] , which foresees the possibility 
of using the same models to perform forecasts over very different time scales, 
ranging from days to years and more. While usually the scholarly literature 
focuses on stochastic parametrizations as crucial tools in this direction |17) , the 
present work underlines that the consideration of - usually neglected - memory 
effects is as important for achieving this goal. 

References 

[1] R. V Abramov. Suppression of chaos at slow variables by rapidly mixing 
fast dynamics through linear energy-preserving coupling. arXiv:1105.3164, 
May 2011. 

[2] R. V. Abramov and A. Majda. New approximations and tests of linear 
fluctuation-response for chaotic nonlinear forced-dissipative dynamical sys- 



11 



terns. Journal of Nonlinear Science, 18:303-341, 2008. ISSN 0938-8974. 
10.1007/s00332-007-9011-9. 

[3] L. Arnold. Hasselmann's program revisited: The analysis of stochasticity in 
deterministic climate models. Stochastic climate models, 49:141-158, 2001. 

[4] B. Cessac and J. -A. Sepulchre. Linear response, susceptibility and reso- 
nances in chaotic toy models. Physica D: Nonlinear Phenomena, 225(1):13 
- 28, 2007. ISSN 0167-2789. doi: 10.1016/j.physd.2006.09.034. 

[5] D.J. Evans and G.P. Morriss. Statistical Mechanics of Nonequilibrium Liq- 
uids. Cambridge University Press, May 2008. ISBN 9780521857918. 

[6] I. Fatkullin and E. Vanden-Eijndcn. A computational strategy for multi- 
scale systems with applications to lorenz 96 model. Journal of Computa- 
tional Physics, 200(2) :605-638, 2004. ISSN 0021-9991. 

[7] K. Hasselmann. Stochastic climate models part i. theory. Tellus, 28(6): 
473-485, December 1976. ISSN 2153-3490. 

[8] P. Imkeller and J.-S. von Storch. Stochastic Climate Models (Progress in 
Probability). Birkhauser Basel, 1 edition, May 2001. ISBN 376436520X. 

[9] Y. Kifcr. Some recent advances in averaging. Modern dynamical systems 
and applications: dedicated to Anatole Katok on his 60th birthday, page 
385, 2004. 

[10] V. Lucarini. Response theory for equilibrium and non-equilibrium statisti- 
cal mechanics: Causality and generalized kramers-kronig relations. Journal 
of Statistical Physics, 131:543-558, 2008. ISSN 0022-4715. 10.1007/sl0955- 
008-9498-y. 

[11] V. Lucarini. Evidence of dispersion relations for the nonlinear response of 
the lorenz 63 system. Journal of Statistical Physics, 134:381-400, 2009. 
ISSN 0022-4715. 10.1007/sl0955-008-9675-z. 

[12] V. Lucarini. Modelling complexity: the case of climate science. 
arxiv: 1106. 1265, June 2011. 

[13] V. Lucarini and S. Sarno. A statistical mechanical approach for the com- 
putation of the climatic response to general forcings. Nonlinear Processes 
in Geophysics, 18:7-28, 2011. doi: 10.5194/npg- 18-7-2011. 

[14] H. Mori. Transport, collective motion, and brownian motion. Progress of 
Theoretical Physics, 33(3):423-455, March 1965. ISSN 0033-068X. doi: 
10.1143/PTP.33.423. 

[15] D. Orrell. Model error and predictability over different timescales in the 
lorenz '96 systems. Journal of the Atmospheric Sciences, 60(17):2219-2228, 
2003. ISSN 0022-4928. doi: 10.1175/1520-0469(2003)060(2219:MEAPOD) 
2.0.CO;2. 

[16] J. Paixoto and A. Oort. Physics of Climate. American Institute of Physics 
New York, 1992. 



12 



[17] T. N. Palmer and P. Williams. Stochastic Physics and Climate Modelling. 
Cambridge University Press, November 2009. ISBN 9780521761055. 

[18] T. N. Palmer, Doblas-Reyes F. J., Weisheimer A., and Rodwell M. J. To- 
ward seamless prediction: calibration of climate change projections using 
seasonal forecasts. Bull. Amer. Meteor. Soc.,, 89:459-470, 2008. 

[19] C. H. Reick. Linear response of the lorenz system. Phys. Rev. E, 66:036103, 
Sep 2002. doi: 10.1103/PhysRevE.66.036103. 

[20] M. J. Rodwell and T. N. Palmer. Using numerical weather prediction 
to assess climate models. Quarterly Journal of the Royal Meteorological 
Society, 133(622):129-146, 2007. ISSN 1477-870X. doi: 10.1002/qj.23. 
URL http : //dx . doi . org/10 . 1002/qj ."23l 

[21] D. Ruelle. Differentiation of SRB states. Communications in Mathematical 
Physics, 187(1) :227-241, July 1997. ISSN 0010-3616. 

[22] D. Ruelle. Noncquilibrium statistical mechanics near equilibrium: com- 
puting higher-order terms. Nonlinearity, 11(1):5— 18, January 1998. ISSN 
0951-7715. 

[23] D. Ruelle. A review of linear response theory for general differentiable 
dynamical systems. Nonlinearity, 22(4):855-870, April 2009. ISSN 0951- 
7715. doi: 10.1088/0951-7715/22/4/009. 

[24] B. Saltzman. Dynamical Paleoclimatology, Generalized Theory of Global 
Climate Change. Academic Press, 1st edition, November 2001. ISBN 
0126173311. 

[25] S. Solomon et al. (eds.). Climate Change 2007: The Physical Science Basis. 
Cambridge University Press Cambridge and New York, 2007. 

[26] G. K. Vallis. Atmospheric and Oceanic Fluid Dynamics: Fundamentals 
and Large-scale Circulation. Cambridge University Press, November 2006. 
ISBN 0521849691. 

[27] D. S Wilks. Effects of stochastic parametrizations in the lorenz '96 system. 
Quarterly Journal of the Royal Meteorological Society, 131(606):389-407, 
January 2005. ISSN 1477-870X. 

[28] J. Wouters and V. Lucarini. Disentangling multi-level systems: averaging, 
correlations and memory. Journal of Statistical Mechanics: Theory and 
Experiment, 2012(03) :P03003, March 2012. ISSN 1742-5468. doi: 10.1088/ 
1742-5468/2012/03/P03003. 

[29] L.-S. Young. What are SRB measures, and which dynamical systems have 
them? Journal of Statistical Physics, 108:733-754, 2002. ISSN 0022-4715. 

[30] R. Zwanzig. Memory effects in irreversible thermodynamics. Physical Re- 
view, 124(4) :983-992, 1961. doi: 10.1103/PhysRev.l24.983. 

[31] R. Zwanzig. Nonequilibrium statistical mechanics. Oxford University Press, 
2001. ISBN 9780195140187. 



13 



